Papers with general-purpose RAOE-S1 model
Rank-Awareness and Angular Constraints: A New Perspective on Learning Sentence Embeddings from NLI Data (2025.emnlp-main)
Copied to clipboard
| Challenge: | High-quality sentence embeddings are critical for advancing a wide range of Natural Language Processing tasks. |
| Approach: | They propose a framework that leverages the full NLI dataset augmented with pre-computed continuous similarity scores (S) they employ a Rank Margin objective that enforces rank consistency against S using an explicit margin and a Gated Angular objective that conditionally refines embedding geometry based on NLI label (L) and S score agreement. |
| Outcome: | The proposed framework outperforms baseline models on STS and the MTEB benchmarks. |